Problem Note 68170: An emoji that is part of a character value is not read into a SAS® application correctly
When you read an external file that contains an emoji, SAS cannot read the emoji as part of the character variable and then returns one of the following messages in the SAS log. In the first message, x is a number referring to the record in the external file:
WARNING: A character that could not be transcoded has been replaced in record x.
ERROR: Invalid string.
FATAL: Unrecoverable I/O error detected in the execution of the DATA step program.
Aborted during the EXECUTION phase.
You can also encounter this WARNING/ERROR when reading Non-ANSI Latin-1 Characters as part of the character variable.
There is a workaround that you can use in a maintenance release prior to SAS® 9.4M6 (TS1M6). You can use a tool outside of SAS to remove the emoji from the external file before you use the IMPORT procedure or a DATA step with the INFILE and INPUT statements to read the external file.
Click the Hot Fix tab in this note to access the hot fix for this issue.
After you apply the hot fix for either SAS 9.4M6 or SAS® 9.4M7 (TS1M7), SAS can read in the emoji and store it in a SAS data set with the correct UTF-8 encoding.
Operating System and Release Information
SAS System | Base SAS | Microsoft Windows Server 2008 | 9.4 TS1M1 | 9.4 TS1M8 |
z/OS | 9.4 TS1M1 | 9.4 TS1M8 |
z/OS 64-bit | 9.4 TS1M1 | 9.4 TS1M8 |
Microsoft Windows 10 | 9.4 TS1M1 | 9.4 TS1M8 |
Microsoft Windows 8.1 Pro x64 | 9.4 TS1M1 | 9.4 TS1M8 |
Microsoft Windows 8.1 Pro 32-bit | 9.4 TS1M1 | 9.4 TS1M8 |
Microsoft Windows 8.1 Enterprise x64 | 9.4 TS1M1 | 9.4 TS1M8 |
Microsoft Windows 8.1 Enterprise 32-bit | 9.4 TS1M1 | 9.4 TS1M8 |
Microsoft Windows 8 Pro x64 | 9.4 TS1M1 | 9.4 TS1M8 |
Microsoft Windows 8 Pro 32-bit | 9.4 TS1M1 | 9.4 TS1M8 |
Microsoft Windows 8 Enterprise x64 | 9.4 TS1M1 | 9.4 TS1M8 |
Microsoft Windows 8 Enterprise 32-bit | 9.4 TS1M1 | 9.4 TS1M8 |
Microsoft® Windows® for x64 | 9.4 TS1M1 | 9.4 TS1M8 |
Microsoft Windows Server 2008 R2 | 9.4 TS1M1 | 9.4 TS1M8 |
Microsoft Windows Server 2008 for x64 | 9.4 TS1M1 | 9.4 TS1M8 |
Microsoft Windows Server 2012 Datacenter | 9.4 TS1M1 | 9.4 TS1M8 |
Microsoft Windows Server 2012 R2 Datacenter | 9.4 TS1M1 | 9.4 TS1M8 |
Microsoft Windows Server 2012 R2 Std | 9.4 TS1M1 | 9.4 TS1M8 |
Microsoft Windows Server 2012 Std | 9.4 TS1M1 | 9.4 TS1M8 |
Windows 7 Enterprise 32 bit | 9.4 TS1M1 | 9.4 TS1M8 |
Windows 7 Enterprise x64 | 9.4 TS1M1 | 9.4 TS1M8 |
Windows 7 Home Premium 32 bit | 9.4 TS1M1 | 9.4 TS1M8 |
Windows 7 Home Premium x64 | 9.4 TS1M1 | 9.4 TS1M8 |
Windows 7 Professional 32 bit | 9.4 TS1M1 | 9.4 TS1M8 |
Windows 7 Professional x64 | 9.4 TS1M1 | 9.4 TS1M8 |
Windows 7 Ultimate 32 bit | 9.4 TS1M1 | 9.4 TS1M8 |
Windows 7 Ultimate x64 | 9.4 TS1M1 | 9.4 TS1M8 |
64-bit Enabled AIX | 9.4 TS1M1 | 9.4 TS1M8 |
64-bit Enabled Solaris | 9.4 TS1M1 | 9.4 TS1M8 |
HP-UX IPF | 9.4 TS1M1 | 9.4 TS1M8 |
Linux for x64 | 9.4 TS1M1 | 9.4 TS1M8 |
Solaris for x64 | 9.4 TS1M1 | 9.4 TS1M8 |
*
For software releases that are not yet generally available, the Fixed
Release is the software release in which the problem is planned to be
fixed.
Type: | Problem Note |
Priority: | high |
Topic: | Common Programming Tasks ==> Reading and Writing External Data ==> with PROC IMPORT SAS Reference ==> Statements ==> File-handling ==> INPUT
|
Date Modified: | 2022-08-29 16:54:11 |
Date Created: | 2021-07-20 15:49:03 |